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ABSTRACT 


The emerging discipline known as “chaos theory” is a relatively new field of study 
with a diverse range of applications (economics, biology, meteorology, etc.). Despite 
this, there is not as vet a universally accepted definition for “chaos” as it applies to gen- 
eral dynamical svstems. Various approaches range from topological methods of a 
qualitative description, to physical notions of randomness, information, and entropy in 
ergodic theory, to the development of computational definitions and algorithms designed 
to obtain quantitative information. 

This thesis develops some of the current definitions and discusses several quantita- 
tive measures of chaos. It is intended to stimulate the interest of undergraduate and 
graduate students and 1s accessible to those with a knowledge of advanced calculus and 
ordinary differential equations. In covering chaos for continuous svstems it serves as a 
complement to the work done by Philip Beaver [Ref. 1], which details chaotic dynamics 


for discrete svstems. 
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I. INTRODUCTION 


In recent vears, new topological methods stemming from work done ın the late 
nineteenth and early twentieth century by French mathematician and physicist Henri 
Poincaré have been applied to the classical “analytical” theory of ordinary differential 
equations. The powerful discipline which has emerged has come to be known as “dy- 
namical systems theory,” with applications not only to continuous, but to discrete sys- 
tems as Well. such as recursive or iterative feedback loops. One result of these methods 
1s the ability to detect, describe, and measure the elusive phenomenon of “chaos.” 

Simply put “chaos” 1s the occurrence of behavior that appears “random” in a 
deterministic dvnamical system, that 1s, a system that changes in time governed at least 
In principle by certain known physical or mathematical laws. It 1s a phenomenon that 
iS intrinsic to many dynamical systems, and not due to external influences such as 
“noise.” Examples are wide-ranging, and include the motion of the planets, turbulent 
fluid low, and population fluctuations. Additional applications have come from many 
fields of study, such as astronomy, biology, chemistry, ecology, economics, geology, 
mathematics, medicine, physics, and some social sciences, as well as various engineering 
disciplines. In addition, many of meee ideas have captured the public imagination, re- 
sulting in a great number of popular expositions. In recent years, various attempts have 
been made to codify these important concepts, and develop a rigorous unifying theory 
oie chaotic dynamics.” 

This thesis introduces the reader to some of the methods of determining the presence 


of “chaos” in continuous systems as Well as measuring it quantitatively. The information 


presented should be accessible to those with a knowledge of advanced calculus and or- 


dinary differential equations. To this end, the proofs of presented theorems which ex- 


ceed this knowledge are referenced for the interested reader. 


Il. BASIC CONCEPTS 


A. SYSTEMS OF FIRST ORDER DIFFERENTIAL EQUATIONS 
We begin with a general system of first order ordinary differential equations ex- 


pressed in the vector form 
ne == [ICO an (1) 


? 


MD. A = fom = le | cinemmandeer— [6 6...f.3eR, where each 
2 n l 


TX 

di 
. . . n . 

Be 1 2...,n assigns a real scalar value to every point xe R and time ze R. Hence 


+ 


= ` nri n ~ . a : ‘ 
ER —R andsofiR —R. For example, with n = 3, equation (1) is equivalent 


to 


xy fr Xu X 1) 
X == Plx, Y)» X, r) . (2) 
X3 O 1) 


Whenever possible vectors will be written in column form, however we may take the 
liberty, as was done for the vectors x and f, to write them as rows. The vector function 
fin equations (1) and (2) is defined as a vector field in R”. In a non-autonomous system, 
f depends explicitly on the variable /. An autonomous system is one in which f has no 


explicit time dependence; in this case equation (1) can be written as 
x’ = f(x), (3) 


where f R° > R” for x e R". 


It should be noted that higher order differential equations can be written as a system 


of first order differential equations. For example, consider the second order differential 


equation 


y' tr5y + dy = 0. 


With new variables defined by 


x y 
A = i 
a ae 
-X2 J 
we have 
a yr Or + Ly’ 
Y : —— — = N 
fey y” —Jy ME 5y' 


i.e., the original eguation (4) is eguivalent to the 2 x 2 system 


A 
O. 
with #= 
le 


(4) 


For methods of converting higher order differential equations to first order systems see 


Borrelli-Coleman [Ref. 2]. 


The general form of a linear system of differential equations ts 


Sn ale til 
= (9) 
N a... Bari) + Zt) 
where F: R > R and each a; R > R, i= l.n, J= 1,...n. Equivalently, 
x = A(x + F(t) (10) 


Mer = (2, (1)=1.... and F: R R is given by F= [Fe Fa]. If the linear system is 
lee n 
autonomous, then a, and F, are constants. A nonlinear system of differential equations 
is one which is not linear. 
1 


If the linear system is such that the functions F, are identically zero, then the system 


is said to be homogeneous and can be written in the form 


x = A(t)x. “ul 


A(t) is a matrix consisting of the same a, as in equation (9). Again, if the linear homo- 
geneous system 1s autonomous, then the matrix A is constant, as in (7) and (8). 

It is also true that a non-autonomous system such as (1) can be written as an au- 
tonomous one. This is done by considering ¢ as a dependent variable, increasing the size 


of the problem from n to n+ 1: 


is equivalent to 
y =gly} (13) 
with 


x n> 1 n> ne fly) 
y= eR and g: R —R given by. g(p) — (14) 
[ | 
Since any system can be written as an autonomous one, it will be assumed without loss 
of generality that the system 1s autonomous unless specified otherwise. 
The general solution to a system of differential equations - denoted 6.x) - is called 
a flow and equation (3) implies that ¢,(«) = /(@,{x)). As an example, d(x) for a third 


order system (1.e., n— 3) takes the form 


PAX) = [20 |. (15) 


and defines a family of solutions or integral curves. An initial condition for the system 
(3) typically has the form x(t) =x), and physically prescribes a point x, e R” through 
which the flow passes at tme r= 4. Under certain conditions according to the basic lo- 
cal existence and uniqueness theorem of ordinary differential equations (see 
Coddington-Levinson [Ref. 3] ), this flow is uniquely determined, so that &,(x) = x. 

Often, without loss of generality, time 4,=0 is chosen for the initial condition; then 


p(x) = Xo 


B. ASYMPTOTIC BEHAVIOR OF FLOWS 

One of the objectives of the modern theory of differential equations, or dynamical 
systems, is to describe the global rather than just the local behavior of flows. To this 
end, we introduce a number of definitions and then provide several examples to illustrate 
them. 

The forward orbit of a flow (x) based at a point xe R° is defined as 
{p{x):0<t<co}. The backward orbit of (x) is defined as {ġ (x): —co<1<0}. The 
full orbit of a flow $ (x) 1s defined as {fd (x): — œ < t < œ}. We remark that an orbit is 
also sometimes referred to as a trajectory. 

A point pe Ris an equilibrium or stationary point if x, =p implies that d (x) =p 
for all : > 0. These correspond to critical points of x(1), and so mav be found by setting 
x’ =0 in equation (3). A periodic orbit of period T is defined as a set [Hd (x):0<1<T) 
seme T 2 0 such that o.) =x. lf o(x)  x for anv 0< r < T, then T 1s the funda- 
mental, minimal or prime period for @{x). The flow of an equilibrium point can be 
viewed as a periodic orbit of period zero. A quasi-periodic orbit is an orbit that is not 
periodic, but which can be written as the sum of “incommensurate” periodic orbits. As 


an example, the flow 


p(x) = cos 2t + cos J2 t (16) 


defines a quasi-periodic orbit. It is written as a sum of periodic orbits, but is not itself 
periodic since 2 and ,/2 are incommensurate (i-e., k,2 + k,J2 #0 for any k, k, integers, 
both not equal to zero). 

Equilibrium points and points of a periodic flow can be viewed collectively as a 
single set of points. These sets of points are specific examples of what will now be de- 
fined as an invariant set. An invariant set A of a flow is a set such that $ (A) = A, where 


we define @,{A) = U P(x). 


A closed invariant set is stable if for every e>0, there exists a ô > O, such that 


|x — All < ô implies that ||6,(x) — Al] < € for all 1>0 (1.e., a flow which starts at a point 





close to A, will stay close to A). Here ‘ || || ‘ is the standard Euclidean distance in R', and 
lx — Al] ıs defined as the greatest lower bound of ||x — y|| for all ye A. A closed invariant 
set A is asymptotically stable if it is stable and if there exists a 6 >0, such that 
le — All <ô implies that ld Lx) — Al — 0 as 1 >00. (1e., a flow which starts at a point 
close to A, will get arbitrarily close to A as time advances). A closed invariant set A 1s 
unstable if for every e >0 there exists a 0 >0, such that lx — A| < ò implies same 
Id fx) — Al > 0 as 1 > — co (i.e., a flow which starts at a poimt close to NH WI EN 
trarily close to A in backward time). We remark that many authors choose to define a 
closed invariant set as unstable simply if it is not stable. The limit set A of a flow is 
defined as the set of all points p such that d (x) > p as t>+co. Note that by con- 
struction, A is an invariant set. 

The following examples of systems of differential equations are provided to illustrate 


some of the previous definitions. 


Example 1 - Population Equation (one dimension) 


x = r(M — x)x (1 


This differential equation can be used as a simple model of bacteria growth in a Petri 
dish. The constant r is the positive rate of growth, and M is the positive limiting pop- 
ulation constant due to factors such as the size of the Petri dish. 

Although this equation can be solved using methods of ordinary differential 
equations, a qualitative graph of its solutions can be formed using simple analysis. First, 
note that the constant functions x=0 and x= M are equilibrium solutions of (17). 


Moreover, if either .<0O or x >M, then x’ <0, so that x decreases with increasing £, 


Likewise if O<x<M, then x’ >0, so that + increases with increasing ¢. Using this 
analysis the family of solutions is plotted for ¿> 0 in Figure 1. 

A phase diagram is one which eliminates the variable z by projecting the flow curves 
onto the space R° of the x-variables. The direction of flow is shown schematically by 
arrows. Obviously, since this process results in an n-dimensional portrait, ıt can only 
be visualized for n= 1, 2, or 3. The phase diagram for the above population equation 
is shown in Figure 2. 

As observed above, the population equation has two equilibrium points: x =0 and 
Bu. hese points can be calculated by setting x =O (Le, r(M -x)x=0) Notice 
that flows with initial points in (O, oo) tend toward M as z increases, and away from M 
as ¢ decreases. This can be seen by either the plot of solutions or the phase diagram. 
Thus the point M (or more precisely, the closed invariant set A = {M}) satisfies the de- 
finition of an asymptotically stable equilibrium point. or sink. Note also, that flows of 
points near but not equal to zero tend away from zero as / increases, and tend toward 
zero as ¢ decreases. Thus zero satisfies the definition of an unstable equilibrium point, 


Or source. 


Example 2 - Simple Pendulum (two dimensions) 


AX = X 
(18) 
X, = w Sin x 
This system of differential equations describes the motion of a pendulum moving 
without friction or air resistance. The variable x, is the angular displacement of the 
pendulum from the vertical, x, is the angular velocity, and œw = g/L, where g is the 
gravitational constant and L 1s length of the pendulum. The process of finding the ex- 


plicit solution to this system of differential equations is described in Borrelli-Coleman 


meer. 2]. 





Figure 1. Population Flows 


The graph of the family of solutions, if plotted, would be in three dimensions with 
variables x,, x,, £. The plot of the phase diagram is in two dimensions, however, and 
provides sufficient illustration. The phase diagram ts plotted in Figure 3. 

The equilibnum points of the simple pendulum are (az, 0) for ne Z. Again, these 
can be obtained by setting x’ = 0 (Le., x,, =0 and x,’ =0 ). Notice that flows with initial 
conditions near the equilibnmum points (2, 0) for ne Z neither converge toward nor 
diverge from these points, but instead form periodic cycles around them. Hence these 
equilibrium points are stable but not asymptotically stable, and the associated cycles 


physically correspond to simple harmonic oscillations of varying amplitudes. The re- 





Figure 2. Population Phase Diagram 


maining equilibrium points ((2n — |)z,0), 2¢ Z have flows which converge to and di- 
verge from them. Hence these points are neither stable nor unstable, and are sometimes 
referred to as saddle points. 

We remark that an asymptotically stable (respectivelv, unstable) invariant set for a 
system can also exist in the form of a limit cycle - a simple closed curve y having the 
property that nearby trajectories (either interior or exterior to y ) spiral towards (re- 
spectively, awav from) y . This phenomenon is typically illustrated by the Van der Pol 
equation, which models a triode oscillator. The Poincaré-Bendixson Theorem essentially 
asserts that amy bounded invariant “limit set” of a planar flow ts either an equilibrium 
point, limit cycle, or union of such objects. This fact is in marked contrast to the be- 
havior of discrete flows, and of differentiable flows in dimensions higher than two, where 
more exotic limit sets, such as “strange attractors,” can exist; see Guckenheimer-Holmes 


4 


[Ref. 4]. 


C. INVARIANT MANIFOLDS 
Ás stated earlier, a linear homogeneous autonomous system of first order differential 


equations can be written 


ans (19) 


where A is a matrix of constants. 


LI 





Figure 3. Pendulum Phase Diagram 


Theorem I: If 4d is nxn and has n independent eigenvectors [v,, ..., va], with corre- 


sponding eigenvalues [/,, ...,4,], then the family of solutions for (19) is 
p(x) = cm en +.. + ne, (20) 


where cee, C are arbitrar constants. 

Proof: (Sketch) Note that x =0 is always a solution to the homogeneous system 
x' = dx. Suppose there exists a nontrivial solution to x — 4x of the form om 
v=0. Substitution of this solution into x’ = Ax yields Av = Av, thus / is an eigenvalue 
of A and v is its associated eigenvector. Due to the linearity of the problem, a linear 
combination of solutions is a solution, and by a fundamental theorem of ordinary dif- 


ferential equations, all solutions must be of this form since we have a full set of linearly 


independent eigenvectors. The details can be found in Borrelli-Coleman [Ref. 2] and 
Boyce-DiPrima [Ref. 5]. 
The c, are determined once an initial condition x(0) = x, ıs given. Ifa given initial 


point x, lies in the direction of one of the real eigenvectors v,, then equation (20) becomes 
At 
Be a 
dx) = ce". (21) 


Thus the flow through x, at ¢=0 remains in the direction of y. If 4,<0, then 
means, 0 (x) — 0 ast—> + co; likewise if 7, >0, then @{x) > coast>+oo. If4,=0 
Men (21) reduces to ov) = cw, — x, (.e.. any x im the direction of v is an equilibrium 
point). 

For the case of complex eigenvalues A=x+ıß and eigenvectors 
vy = Re{v} + Im{r}, i=, -1 , the following can be shown. If the initial condition x, lies 
in the plane spanned by Re{v,} and Im{v,} then equation (20) can be written in real form 


as 
p(x) = ne COS pt T cae” sin pt. (22) 


This implies that the flow remains in the plane spanned by Re{v} and Im{y} and forms 
a spiral due to the trigonometric functions, which are oscillating, bounded, and periodic. 
The direction of the spiral depends on the sign of a. If « <0, the flow spirals in toward 
the origin. If « >0, the flow spirals out toward infinity. If a =90, the flow forms a pe- 
riodic cycle about the origin. The constant f determines the rate at which the flow 
spirals. 

It should be noted that for a real matrix A, if A, is a complex eigenvalue then its 
associated eigenvector v, is complex. In addition, the complex conjugate y of À, is nec- 
essarilv an eigenvalue and has associated eigenvector ©. Note that Re{/,} is equal to 


Re(4). 
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With these cases in mind, one can divide R” into three classes of invariant subspaces 
called eigenspaces. The stable eigenspace is defined as E = spanfv, v, ..,v,), where 
Vp tz, V, are the ergenvectors associated with ergenvalues that have negative real parts 
with ¢ =dim(E). The unstable eigenspace E" = spaníw,, w,, ... w,), where wy, wy, .., W, 
are the ergenvectors associated wrth ergenvalues that have positive real parts, and 
v=dim(E”). The center eigenspace E = spanfu,, tU, .., uy}, Where 1, %,... 4, arc 
eigenvectors associated with eigenvalues that have real parts equal to zero, and 
y =dim(E). The sum of the dimensions for the cigenspaces is equal to the dimension 
of the entire space R” (Le., o Fry —n). Keep in mind that for complex eigenvectors 
v. and vr, the spanning vectors for the appropriate ergenspace are Re(r)j and Im{v}. 
Figure 4 1s a general phase diagram illustrating the three ergenspaces; a) n=2, with 


a—l.»—l.b)n—o,withg—l.»—-l;andcyn— thc R 


For example, consider xx —l' werc 


I o 
O 

a (23) 
0 0 0 
(ib OO 


A has eigenvalues 0, 3, -1+t, -1-1 and associated ergenvectors [1 IA 
[1,2,0,03, ([0,0,0,—1]+1[0,0, 1,03, [0,0,0, —1]—1[0, 0, 1,0] respectively. Thus 
E' — span([0,0,0,—1], [0,0,1,0]), E'—< span([1,2,0,0]), E — span([1, — 1/0 
It is always true that zero 1s an equilibrium point for x’ = Ax, regardless of 4. Note 
that for A n x n, If the dimension of ° is equat to n then zero is an asymptotically stable 
equilibrium point. If the dimension of E” is equal to n, then zero is an unstable equi- 


librrum pornt. 





Figure 4. Eigenspaces 


The subspaces E', E”, E” are easily formed when the matrix A has n independent 
eigenvectors. Ifthe matrix £A does not have n independent eigenvectors, the “missing 
ones” can be constructed using technigues described in Boyce-DiPrima [Ref. 5]. These 
“generalized” eigenvectors are placed in the appropriate eigenspace depending on the real 
part of its associated eigenvalue. 

For a linear system, flows can be classified rather easily. For a nonlinear system, 


this is generally not the case. A common method in describing the dynamics of a non- 


linear system ıs to linearize it in a neighborhood of an equilibrium point, so that the 
analysis above may be applied locally. Given a nonlinear system x’ = x) and an equi- 


hbrium point p, the linearized system ts given by 




















x" = Ax, (24) 
| Č | | | E 
where 4 = Dp) =] — |, is the Jacobian matrix of f evaluated at p. For ex- 
3 22 = yeee n 1=p 
ample, with xe R, 
of th af 
OX, OR, CX; 
ch ch ch 
DAp) = - — E 23 
Ap) CX, OX) 0x; > 


ch Cf Ch 


OX, eo CX; 











We need the following definitions. The local stable and unstable manifolds of p, 


W...(p), Wp) respectively, are defined as follows: 
Wop) = {x € Ur 6x) > p as t > + œ, and (x) € U for all 1 > 0} (26) 
Wilp) = {x e U: ġ{x)— p as t > — co, and $x) € U for all : <0) (27) 


where UCR" is a neighborhood of p. The Stable Manifold Theorem below loosely states 
that nonlinear systems “resemble” linear systems on a local scale, in the sense that the 
dvnamical roles of the invariant eigenspaces (lines, planes, or “hyperplanes” in higher 


dimensions) are now played by invariant curves, surfaces, or “manifolds” in general. 
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Theorem 2: Suppose that Df{p) has no eigenvalues with real part equal to zero. 
Then there exist unique local stable and unstable manifolds Wip), Wiep), of the same 
dimensions as those of the eigenspaces E”, E” of the linearized system (24), and tangent 
to E, E at p; see Figure 5. 

Proof: Guckenheimer-Holmes [Ref. 4] references the proof, which uses the Implicit 
Function Theorem from advanced calculus. 


An example which uses the result of Theorem 2 1s the nonlinear system 


which has a unique equilibrium point at the origin (0,0). The associated linear system 


1 0 
we oo (29) 
O -1 


DA(0,0) has eigenvalues | and -I with associated eigenvectors [1, 0] and [O0, 1], re- 


about the point (0,0) 1s 


spectively. 

Thus by Theorem 2, the nonlinear system about the point (0,0) has a one- 
dimensional unstable manifold W,,,(0,0) tangent to [1, 0], and a one-dimensional stable 
manifold W,,.(0,0) tangent to [0, 1]. This can be verified by direct computation. First, 
if x,(0) = O (1.e., an initial point is chosen on the x-axis), then it follows by solving the 
first equation of (28) that x,(z) z O for all 4 > O, and thus by the second equation of (28), 
x(1) >0 as 1 >=+00. Hence W,.(0) = E(0). Moreover, the explicit solution to (28) 


can be represented (non-parametrically) by the curves x, = Lx + Cx|; then W;(0) is the 





Figure 5. Schematic for Theorem 2 


parabolic member of this family corresponding to C=0. Figure 6 depicts the 
eigenspaces and manifolds for this example. 
The local manifolds W,,.(p), W,,.(2) have global analogues independent of the U in 


(26) and (27) which are defined by letting £ > — co and f- + co, respectively: 
$ U eas 3 
W (p) = 1<0 P Wio) (30) 


Wa) = Y bf Wiel) - (31) 


If DAp) has eigenvalues with real part equal to Zero, then there also exists a corre- 
sponding center manifold W“(p), tangent to, and having the same dimension y as, the 
center eigenspace E”. The existence of W“(p), which need nor be unique for a given sys- 
tem, is the content of the Center Manifold Theorem. The dynamics of a system on this 
manifold are generally more complicated than on the others, and a detailed analysis is 
bevond the scope of this thesis. Guckenheimer-Holmes [Ref. 4] provide a detailed 


discussion of center manifolds. 





Figure 6. Eigenspaces and Manifolds 


Clearly, by definition. W(p) and W'(p) are invariant under the flow (x), and 
pe W(p)(\ W(p). If there exists a distinct point g ec W (p)( W'(p) as well, then it fol- 
lows that b(g) > p as (— £ oo, and g is said to be a homoclinic point to p, with corre- 
sponding homoclinic orbit (dg), -co<< oo. Clearly, if q is homoclinic to y, then so is 
any other point in the orbit @q), hence there will be an infinite number of such points 
in general. Figure 7 illustrates a homoclinic orbit. 

The formation of homoclinic points and orbits plays an important role in the de- 


velopment of chaotic dynamical behavior, as will be observed in subsequent chapters. 


qeW? (9)0w”(p) 





Figure 7. Homoclinic orbit 


IM. DEFINING CHAOS 


A. POINCARE MAPS 

Pesewe sitall see, there are many ways tO approach the definition of “chaos.” We 
begin with one such approach, Poincaré maps. As seen earlier, one way to help char- 
acterize the dynamic behavior of a nonlinear system of differential equations is to 
linearize ıt ın a local area. Another technique 1s to discretize it. By analyzing “snap- 
shots” of a continuous solution, We can infer certain properties about it. These “snap- 
shots” (discretization) form the foundation for Poincare maps. 

We start with a third order (re R`) autonomous system and a suitable two- 
dimensional surface (for example. a plane) IT such that the flow e,(x) under observation 
repeatedly intersects I] transversely (1.e., nontangentrally). The image of a point ve TI 
under the first return or Poincaré map P: I > IT 1s defined as that point along the flow 
d (x) which next intersects the surface I]. Varying definitions are possible tf the direc- 
Menem which ex) crosses II is taken into account. There are also cases where a well- 
defined Poincaré map 1s not possible. Moreover the definition of a Poincare map can 
be extended to the general case xe R', n> 3. Instead of using a two-dimensional sur- 
face for [I , a hypersurface of dimension (n-1) 1s chosen. Figure 8 shows the con- 
struction of a Poincaré map for x e R°. 

As with continuous systems, discrete systems have their own accompanying set of 
definitions and properties. A common example of a discrete dynamical system is an it- 
erated function. Ałthough the following definitions are stated for one dimension we will 
show how they can be extended to higher dimensions. 

Given a function gR>R and an initial value x) eR, the sequence 


{xo g(xg), g(g(xc)), g(g(g(xg))), ...) is defined as the forward orbit of x, under g. Note that 





Figure 8. Poincare Map 


the recursive formula x,., — g(x,) with initial condition .x, is an equivalent definition for 
the forward orbit. Provided that g has an inverse, the backward orbit of x, under g is 
defined as (x, gx), g (g(x)), -..). (This definition can be generalized” bv acme 
g'(x) = fye R: g(y)=x}.) The full orbit of x under g is defined as 
(.... gn (g'(x,)), g'(xe), Xo. g(xg), g(g(xg)),...)- Forward and backward orbits ôf 2 arc Os 
parable to the forward and backward orbits of a flow f(x) in the continuous system. 
Thus, the sequence of points (xp, x,, X,, ---) generated by the intersection of the flow 
@ (x) with TI in Figure 8 is the forward orbit of a point x, under the Poincare map 
PT nm. 
[n discussing iterative functions it is convenient to use the following notation: 
g*(x) — (gogo...og)(x), 
(32) 
n times 

for n=1,2,3,..., Where the symbol o denotes function composition, and g"(x) = (g"(x))". 
The point p is defined as a fixed point of g if g(p) =p. A point q which is not a fixed 


point is defined as eventually fixed if g(q) is fixed for some me Z`. More generally, a 


point p is periodic of period n if g°(p) =p. Note that if p has period n, then it automat- 
ically has periods of all (positive) integer multiples of n. This motivates the next defi- 
nition: a point p is periodic of prime period n if g°(p) = p and there does not exist an m 
such that 0 <m<n and gp) =p. A point g which ts not periodic is defined as eventu- 
ally periodic if g™(q) is periodic for some meZ . 

The definitrons above extend to spaces other than R. For example, consider code 
space 2 the collection of all infinite binary strings s,5,5,..., s,€ {0,1}. and the shift map 


g: X œ> È giren by 
£(S, $753...) = 535354... : (33) 


The fixed points of g are 000, 111 (The bar indicates an infinite repeating block). The 
point 01000 is eventually fixed. The point 001001 is a periodic point of prime period 
three. The point 10001001 is eventually periodic. 

Given that g 1s differentiable the followmg definitions also hold. A periodic point 
of prime period n ts hyperbolic if | (g*)’(p) | + 1. Note that a fixed point is equivalent to 
a periodic pot of prime perrod one. Thus a fixed point is hyperbolic if | g’(p) | # 1. Also 


note that (g*)’(p) ın general is calculated by the Chain Rule: 
(27 (p) =8 (8% (p) ... 8'(8(p))g'(p) . (34) 


me ample, if p is a periodic point of prime period three of the sequence 


Tr et, aep) =-1, e(p)= 1, ...} then 
(g”)'(1) — g'(-1)g'(O)g'(1) . (35) 


Clearly, this is also the common value of (g?)'(0) and (g*)'(-1). A periodic point p is 
non-hyperbolic if | (g")’(p)|=1. A periodic point p of prime period n is attracting if 


|(g")'(p)| <1. The point p is repelling if | (g*)’(p)| > 1. A good introductory reference 


that covers chaos for discrete systems is Beaver [Ref. |]. A more rigorous treatment is 
found in Devaney [Ref. 6]. 


For higher dimensions R” the iterative system takes the form 


u) (TV), JO) (m) 
An = || = Ar , er , An ) 
(2) (2), 10) (2) Âm) 
“nl ò ( fone een ) 
= | (36) 
.(m) (m), .(D (2) (m) 
a gnn ^'n eee 
equivalently, 
ee (37) 


m 


where xe R” andg: R° >R”. 

Definitions for higher dimensions extend in the obvious manner with the exception 
of the hyperbolic, attracting and repelling periodic points. A periodic point p of prime 
period n is hyperbolic if the Jacobian matrix D(e°)(p) has no eigenvalues of unit modulus, 
that 1s, no eigenvalues on the unit circle | z| — 1 in the complex plane. (We remark that 
this definition extends to all points of any limit set A; in this case we sav that the entire 
set A is hyperbolic.) The Jacobian can be computed with the aid of the Chain Rule as 


before: 
D(g"\(p) = De(g™ '(p)) ... De(g(p))Dg(p). (38) 


The multiplications above are matrix multiplications. If all the eigenvalues of D(g")(p) 
have modulus less than one then the periodic point p is attracting. If all the eigenvalues 
have modulus greater than one, p is repelling. An attracting fixed point can be shown 


to be asymptotically stable, and hence is sometimes referred to as a sink. Likewise a 


repelling fixed point is said to be a source. If some eigenvalues lie in the interior of the 
unit disk while the remaining ones lie outside, then a fixed point p is a saddle point. 

As one might expect, eigenspaces and manifolds exist for discrete systems similar to 
those just discussed in the previous section for continuous systems. The position of the 
eigenvalues in relation to the complex unit circle 1s the determining factor for discrete 
systems, as opposed to continuous systems where it 1s their position relative to the im- 
Amar axis (1.c., stable if Re{/A} <0, unstable if Re{/} > 0, etc.). The interested reader 
is referred to Guckenheimer-I folmes [Ref. 4]. 

We now return to the process of using the information gained by Poincaré maps to 
Characterize the behavior of an n™ order nonlinear continuous system. Recall that in this 
case, the Poincare map is a mapping between two (n-l)-dimensional spaces. 

By construction, a periodic orbit of a continuous svstem corresponds to a discrete 
periodic cycle of some Poincaré map (Figure 9), such as a fixed point, for example. If 
the fixed point ıs stable then the periodic orbit is asymptotically stable. Ifthe fixed point 
is unstable then so is the periodic orbit. If the fixed point is neither stable nor unstable 
it is possible to relate the dimensions of the manifolds of the fixed point to the manifolds 
of the periodic orbit. The reader is referred to Guckenheimer-Holmes [Ref. 4] for a 
more in-depth discussion of the relation between the discrete manifolds of the Poincare 
map and the manifolds of the continuous system. 

A quasi-periodic orbit of a continuous system that consists of only two 
incommensurate periods corresponds to some Poincaré map of embedded circles. For 
a quasi-periodic orbit of K incommensurate periods the Poincare map consists of a 
generalized (K-1) - tori. The idea is that for a quasi-periodic orbit the corresponding 
Poincaré map is one of compact (closed, bounded) geometric structure. For a discussion 


of Poincare maps corresponding to quasi-periodic orbits see Parker-Chua [Ref. 7]. 
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Figure 9. Poincare Map for a Periodic Orbit 


Although we have vet to define chaos, those continuous orbits which are chaotic 
have corresponding Poincaré maps whose images are very distinctive and often quite 
beautiful. These images are distinctive in that thev seem to possess a more complex 
geometric structure than those of periodic or quasi-periodic orbits. In an effort to 
guantifv this apparent increased complexity, various definitions of “dimension” have 
been formulated which for these exotic sets can take on non-integer values. Several of 


these definitions are discussed in a subsequent chapter. 


B. SMALE HORSESHOE 

We continue our approach toward a definition of chaos with the following example 
of the Smale Horseshoe map, a two-dimensional discrete map that exhibits many of the 
features which are normally associated with “chaotic” dynamical systems. This map can 
arise as a Poincaré map for a three-dimensional autonomous system. It 1s also closely 
related to homoclinic orbits which were briefly introduced at the end of the section on 


manifolds. 


Before beginning our example a few preliminaries are needed. We have already seen 
how the ability to relate the dynamics of one system to another can be very powerful. 
Another much stronger method for accomplishing this relation is topological conjugacy. 

Let S and T be sets; the function 4: S > T is a homeomorphism if it is continuous, 
One-to-one, onto and has a continuous inverse. Two maps f: S > S and g: T > T are said 
to be topologically conjugate if there exists a homeomorphism A:S — T such that 
hof=goh. The function A is defined as the topological conjugacy. Figure 10 is a 
schematic for topologically conjugate maps fand g. and we say that the diagram “com- 
mutes.” 

The following is an example of two topologically conjugate functions. Let 


S = [9,1], T =[-4, 5]. and let £S—S.g: T— T, and A: S > T be given by 


ASEO 
ea) =x7+.25 (39) 


h(x) = —x+.5. 
Then 


Me — Ds 
(40) 
and goh=x -x+5. 
Sınceehog=gohandhısa homeomorphism, the functions f, g are topologically con- 
jugate. 

The power of thıs relatıon ıs that topologically conjugate maps fand g have com- 
pletely equivalent dynamics. If fhas a stable fixed point p then g has a stable fixed point 
h(p). More generally, any given orbit of f is mapped to a corresponding orbit with 
equivalent dynamics in g via the homeomorphism h. For the example above, p =0 is a 


non-hyperbolic fixed point for f and A(0) — 0.5 is a non-hyperbolic fixed point for g; 





Figure 10. Topological Conjugacy 


equivalent dynamics are in fact suggested by comparing the graphs of f and g, respec- 
tively. 

Thus if we are able to establish a topological conjugacy between a map with un- 
known dynamics and one with which we are well acquainted, then the dynamics of the 
original map will be completely known. As expected, it may not be an easy task to es- 
tablish such a topological conjugacy. 

The other concept we will need in discussing the Smale Horseshoe is one we have 
already covered for continuous systems. An invariant set A for a general map : S—S 
is a subset ASS such that AA) = A, where TA) = (Ax): x e A}. Fixed points and periodic 
sequences are trivial examples of invariant sets. A method of constructing an invariant 
set for f, which may not be trivial, is to take the infinite intersection of the forward it- 


erates of the entire domain and intersect them with the corresponding backward iterates, 


that is, 


A= 1/8 
zum N FS) . 


It is this construction which we will use to obtain an invariant set for the Smale 


Horseshoe map. 


Let S be the unit square I’; contract it vertically by a factor of one-quarter, and ex- 
pand it horizontally by a factor of four. Next bend it into a horseshoe-like shape and 
superimpose it back onto the unit square S. Call this geometric mapping f. The map 
f.S > Scan be formulated algebraically but the geometric presentation promotes clarity, 
and 1s diagrammed in Figure 11. 

Let m=1 in (41); the first iteration f(S) consists of two horizontal bars which we 
have labeled IH and FF. In order to find the backward iterates, perform the map in re- 
verse. This process is shown in Figure 12, and results in two vertical bars, labeled V’ and 
a fe spectively, such that AV) = 11 and AV) = |I. The intersection of one forward it- 
Ion and its backa a aois shown meFieure 13, and results in four shaded 
blocks which contain the invariant set A. Each block can therefore be represented as 
some H! AN V”, where SS € {0.1}. which then corresponds to a unique binary address 
of the form s,.5,, also shown in Figure 13. Thus, any point x in such a block has the 
property that x e V” and xe IE", the latter of which imphes that f (x) Eee This sug- 
gests that the vertical bars V” and V may eventually be used as the basis for tracking the 
orbit of a point in A via a binary sequence. 

Let m=2 in (41); we now consider the forward and backward iterations of the 
intersection depicted in Figure 13. These second forward and backward iterations are 
shown in Figures 14 and 15. Notice that the second forward iteration gives rise to four 
horizontal bars which are subsets of If’ and H’. (Equivalently, these four horizontal bars 
can also be characterized as fS); see Figure 16.) The second backward iteration results 
in four vertical bars. Like the horizontal bars, the four vertical bars are subsets of V° 
and V'. The intersection results in sixteen blocks (see Figure 17) which contain A, and 
may be assigned four-digit binary addresses according to a prescription similar © that 


given above. 


VERTICAL 
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HORIZONTAL 


y EXPANSION 
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Figure Il. First Forward Iteration 


[n general, the n® forward iteration will result in 2° horizontal bars which are subsets 

A . a : > a ‘ 
of the 2” horizontal bars of (n-1)" forward iteration, and likewise for the vertical bars 
with respect to backward iteration. By taking the infinite intersection of the forward it- 


erates of S and intersecting them with their corresponding backward iterates, we con- 
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Figure 12. First Backward Iteration 


struct (by the Heine-Borel Theorem of advanced calculus) a nonempty invanant set A 
of f, and a map A on A such that each and every point xe A has a corresponding ad- 


dress, or itinerary, h(x), which is representable by a binary bi-infinite sequence: 


2i 





Figure 13. First Iteration Intersection 


n(x) = e83 S.S., II, (42) 


where 


i (43) 


| VA 
= I 
SS 


This sequence is simular to the code space used in (33) except that it is bi-infinite. We 


P 


will denote this space of binarv bi-infinite sequences as &’. [t is possible to show that 
the map Ah: A = XL’ is a homeomorphism, and is an example of the use of symbolic dy- 


namics. 


Finally we define a shift map g: X' — Y” such that 
g(...S:3$.>S.j-Sg$y$2:) = ..-S 380505 Se (44) 


Theorem 3: The maps f and g defined above are topologically conjugate with 


topological conjugacy hk. 





Figure 14. Second Forward Iteration 


Proof: The proof of this theorem is closely linked to the proof of Theorem 5.1.1 


of Guckenheimer-Holmes [Ref. 4]. 


33 





Figure 15. Second Backward Iteration 


Since fand g are topologically conjugate we can equate the dynamic behavior of g 
with that of f. The map g has certain properties which will form the definition for chaos 


in the next section. 
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Figure 16. /(S) 


Our first goal Is to show that two points in Y’, initially “close”, start to diverge from 
one another under forward iterations of g. This property of a map ts known as sensitive 
dependence on initial conditions. A mathematical definition is given by Devaney 


[Ref. 6]. A map g: T > T has sensitive dependence on initial conditions on T if there 


SEN 
AS 





Figure 17. Second Iteration Intersection 


exists e > 0 such that, for any x e T and any -neighborhood N of x, there exists y e N 
and n >0 such that d(g (x), g(y)) >. 
[In the previous definition d(s, 7) represents an appropriate "distance measuring” 


function, or metric for the space T. For our example the space T is equal to ©’ and 


oo 
Ed E 
dis) 7 (45) 
7 
lz—oo 
(Or S S ...$,,.Sy$y... and (— ...(,.(yf,... i 2'. Using the definition of sensitive dependeno EN 


initial conditions it is possible to show that the map g, and thus f, has this property with 
respect to the metric given above. 

For example, suppose s and r agree in positions 1=-100 to 100 and disagree in the 
remaining positions. Then s and ¢ are initially “close” to one another: d(s,r) < 274 


201 201 
However after 201 iterations of g, g (s) and g (4) are quite widely separated: 
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20 201 , . : 4 > 
d(g (s), g (t))> 2.99. In this way, given any arbitrarily small neighborhood N of s we 


can find a distinct point zın N such that d(g (s), e (0) 7 ior some nm 0 Since f and 
g are topologically conjugate there are exactly two points x and y in A that correspond 
via the homeomorphism A: A > Y' to the sequences s and rin Y”. llence f exhibits sen- 
sitive dependence on initial conditions on A . 

Our second goal is to show that g is topologically transitive. Devaney [Ref. 6] de- 
fines a map g: T — T as topologically transitive on T if for any pair of open sets 
=. = T there exists k > 0 such that g (UNV + O, that is, any two subsets of T even- 
tually intersect. lf g contains a dense orbit, that is, if there exists a point s in ©’ whose 
orbit becomes arbitrarily close to all points in %’, then it follows that g is topologically 
transitive. 

Consider the point s constructed in the following manner: 

s =...0.001 10 11 0000 0001 ... L111 000000 000001 ... 
a a. (46) 
all 2-blocks all 4-blocks all 6-blocks 
During the first seven iterations, the orbit of s will have agreed in the 1=-1 and ı=0 
positions with every point in ÈE. There are only four possible binary numbers of length 
two and in seven iterations the orbit of s has covered them. 

In the next 64 (2° x 4) iterations the orbit of $ will have agreed in positions 1= -2 to 
| with every point in £’. The construction of s is such that in a finite - although possibly 
large - number of iterations, the orbit of s will agree in positions i=-n to n-I with every 
point in X', for anyn> 0. ln other words, the orbit of s gets arbitrarily close to every 
Amber in X’. 

Our final goal is to show that periodic points are dense in © (i.e, show that every 
point in £’ has a periodic point arbitrarily close to it). Consider any point se X’, then 


Mean be represented as 
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Su 15.48: Se (47) 


Choosing an arbitrary distance between s and a periodic pont pe X' ¡s equivalent to 
choosing an n sufficiently large that p and s agree in positions 1=-n to n. Thus construct 


p in the following manner: 


— cc c rp e AAA > 
A A A OS a (38) 


The bar underneath indicates repeated blocks to the left and the bar on top indicates 
repeated blocks to the right. Note that p agrees with s in positions 1=-n to n and is 
periodic of order 2n+1. By constructing p in this manner we have shown that any 
sé’ has a periodic point arbitrarily close to 1t. Therefore periodic points of g are dense 
eee 
In summary, g: X' — XL’ is a map for which 
l. g has sensitive dependence on initial conditions, 
2. gis topologically transitive, 


periodic points of g are dense in Y”. 


lsd 


Since g is topologically conjugate to the Smale Horseshoe map f A > A, fand g share 


these three properties. 


There is in addition an intimate connection between this map and the existence of 
homoclinic points, which we will state more precisely in the following chapter. Recall 
that a point q is homoclinic to a fixed point p if g + p and q e W(p) NM W (p). Now, since 
AV’) = HP, it follows that the block V° N H’ is mapped to itself by f, hence it contains a 
fixed point p having itinerary 0.0. Clearly, any point q with itinerary Os ....5.1-.50. Sn OFN 


the property that 


dg (p).g'(G)>0 as k>+oo, (49) 
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thus q e Wip) NM W“(p), and there are infinitely many such intersection points q. More- 
over, we may similarly construct a point q satisfying (49) for any point p e A; in this case 
q is both forward and backward asymptotic to p, respectively. 

The convoluted intertwining of the stable and unstable manifolds is a result of the 
shrinking, stretching, and folding effects of the map and leads to sensitive dependence 
on imitial conditions, topological transitivitv and dense periodic points (see Figure 18). 
For this reason, in practice, the numerical detection of horseshoes in a particular dy- 
namical svstem is often identified with the presence of chaos. 

It should be noted that the Smale Horseshoe map has many variations. Although 
our map contracted and expanded by orders of four thev can be generalized to a con- 
NG HO factor z , Ô< 4 < '4 and an expansion factor 4 , 4 > 2. The orientation of the 
Horseshoe with respect to the unit square need not be horizontal or vertical. Even the 
unit square may be varied to other domains. 

Note also that the use of symbolic dynamics enabled us to take what were onlv ob- 
servations (geometric properties of the Smale Horseshoe map) and make them math- 
ematically precise. That is, we were able to perform rigorous analysis which was not 
possible earlier without the use of symbolic dynamics. 

The invariant limit set A also requires further discussion. It 1s constructed by an 
explicit procedure that results in a sequence of disconnected sets which have some in- 
teresting properties. Note that each of the small groups of four blocks in Figure 17 is 
a contracted and translated copy of Figure 13, as each block in Figure 13 1s such a copy 
of the original unit square S in Figure 11. This property of self-similarity persists 
throughout the procedure and ultimately carries through to the invariant set A itself. 
This kind of recursive construction - sometimes referred to as an iterated function system 
(IFS) - can be used as the basis for computer generation of other types of “fractal” 1m- 


ages. These limit sets may be viewed as “attractors” of certain “affine maps” (linear fol- 
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Figure 18. Intertwining of Stable and Unstable Manifolds 


lowed by a translation, thus representable by matrices) on subsets of R', and therefore 
can be addressed by using a variation of code space. The resulting fractal attractor a 
is unique, and has “dimension” which is not necessarily an integer, but may be a frac- 
tional value, for example (and hence the name). For a discussion of iterated function 
systems see Beaver [Ref. 1]. 

The invariant limit set A of the Smale Horseshoe is itself closely related to a well- 
known subset of che interval (0, 1], the Cantor Ternary or Middle-Thirds Set. This set 
is constructed recursively by the repeated removal of open middle thirds from all current 
intervals. Thus, removing the open middle third from (0, 1] results in two closed inter- 


vals: [0, +] and [2,1]. Repeating this procedure results in four closed intervals: 


[0, +], (4, +], £4, s] and [ 4, 1]. Upon infinite iteration we are left with the Cantor 
set. Although this straightforward construction may seem rather trivial, the Cantor set 
has many interesting properties Which are shared by the invariant set A. Vor example, 
both the Cantor set and the set A are totally disconnected, that 1s, for everv x € A there 
exists an open ball, Bi (x) — (y: d(x3) < ô) centered at x of radius ô which contains no 
points of A other than x. In fact, A itself mav be viewed as a “higher dimensional” ver- 
sion of the classical Cantor set that exists in the unit square rather than the unit interval. 


Dora More complete discussion of fractals and the Cantor set see Beaver [Ref. 1]. 


i CHAOS 
Micere is No Universally accepted definition for Chaos. For discrete svstems we shall 
adopt the definition given by Devaney (Ref. 6]. Let S be a set. The map f: S => S 1s said 


to be chaotic on S 1f 


l. fhas sensitive dependence on initial conditions, 


2. f is topologically transitive, 
Beeperiodic points of f are dense in $. 


Note that the Smale Ilorseshoe map is chaotic on the invariant set A. Also note 
that the Smale Ilorseshoe map 1s not chaotic on the set I”, the unit square, since periodic 
points are not dense in I’ (i.e., we can find an open neighborhood in I’ which does not 
contain a periodic point). ; 

In a recent article published in the American Mathematical Monthly (Ref. 8], J. 
Banks et. al. prove the following theorem: 

Theorem 4: If f: S > S is transitive and has dense periodic points, then fhas sensitive 
dependence on initial conditions. 

Proof: A sketch of the proof follows. Let x be an arbitrary point in S, and 6 > 0. 
Define the open ball centered at x of radius ô as B(x) = {p e S: d(xy) < 6}. By the Tri- 


angle Inequality, 1t can be shown that there exists a periodic point g whose orbit, O(q) 
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is of distance at least 40 from x. Since periodic points are dense in S, there exists a point 
p e B(x) which is periodic of, say, period n. There also exists a point z e B,(x) such that 
f (z) comes within 6 of one of the points in O(g) for some integer j. This follows from 
the fact that fis transitive and requires careful construction of neighborhoods about the 
points in O(g). Once again by wavy of the Triangle Inequality and the fact that 
f (p) =p. it can be shown that d(f'(p). f (2) > 26. A final application of the Triangle 
Inequality implies that either Ir Le o or d(f (x). f (p)) > d. Thus for any 
neighborhood N of x, there exists a point in N, either p or z, such that the distance as 
tween them after ‘nj’ iterations is greater than ò. This is exactly the definition of sen- 
siuve dependence on imtial conditions. For complete details see Banks et. al. [Ref. 8]. 

Thus in order to show that a function f: S — S is chaotic, we need only demonstrate 
that periodic points are dense in S and f is topologically transitive. Theorem 4 ımplies 
that f will also have sensitive dependence on initial conditions. 

For a continuous system, chaotic dynamics are usually linked to the appearance ar 
the Smale [forseshoe map (or one of its variants) 1n its associated Poincaré map, giving 
rise to homoclinic points and orbits which can often be detected numerically. Alterna- 
tively, chaotic behavior is often described using quantitative measures such as various 
non-integer “dimensions” that are associated with “strange attractors.” Loosely speak- 
ing, these are exotic Cantor-like limit sets which exhibit distinctive structure suciis 
guasi-self-similarity, a property that is normally associated with “fractal” sets. We will 
discuss these topics in greater detail in the secuons that follow. 

Like chaos, no single accepted definition for a “strange attractor” exists. In fact, 
definitions vary quite substantially. To illustrate this variance we provide the following 
(Womlelinitions#Omas strange alinacioar. 

The first is provided by Rasband [Ref. 9] and is presented as a practical definition. 


A set A is called an attracting set for the dynamical svstem x’ = f(x) with flow designated 


by (x), if there is some neighborhood U of A such that H(x) e U for :>0 and 
(x) > A (1.e., llo (x) — Al > 0) as 1 => +00 for all xe U. A strange attractor is then 
defined as an attracting set with non-integer “fractal dimension.” Several measures of 
fractal dimension exist, some of which will be discussed in a later chapter. 

Before stating the second definition from Guckenheimer-Ilolmes [Ref. 4] we provide 
some preliminary ideas. A closed ınvarıant set A ıs indecomposable ıf for every pair of 
y ni and e there are pomts X = Xy, Y, «Xp, X= Y and /,,...,4,> I such 
that the distance from @,(x,,) to x, 15 smaller than e (see Figure 19). That is, for any pair 
of points x and y in an indecomposable set, a “chain” of “nearby” flows can be con- 
structed that links x to y. 

The “Lebesgue measure” of a set UCR’ is a non-negative real value that can be in- 
formally described as a generalization of the notion of length. area, or volume (for 
Meee, Or 3, respectively). and in fact, reduces to this in “simple” cases. A set having 
positive Lebesgue measure need not however have a topological “interior” in R”. (For 
example, the Lebesgue measure of the interval I = [0.1 ]JCR is one, while that of the ra- 
tional numbers @ in I can be shown to be Zero. From this it follows that the comple- 
ment, the irrational numbers I — O in [0,1], has Lebesgue measure one, even though this 
set contains no open intervals.) A rigorous definition lies beyond the scope of this thesis. 
For an in-depth discussion of measure theory, see Royden [Ref. 10]. 

Eeccall thal gq tS a homoclmic pomt to a fixed pont p if gzp and if 
q e Wp) Ñ Wp). A homoclinic point g is transversal if the tangent vectors to Wp) 
and W(p) do not coincide, and gives rise to a transversal homoclinic orbit, 
(Pp Lg): DOE co}. 

Guckenheimer-flolmes [Ref. 4] provide the following definition for a strange 
attractor. An attractor is an indecomposable closed invariant set A with the property 


that, given ¢ > 0, there is a set U of positive Lebesgue measure in an e -neighborhood 
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Figure 19. Schematic for an Indecomposable Set A 


of A such that x ¢ L implies that @,(x) for some subsequence 4, as f, + + oo, is contained 
in A and the forward orbit of x is contained in U. An attractor is called strange if it 
contains a transversal homoclinic orbit. This is called a chaotic attractor by some au- 
thors, and is consistent with the development of the notion of chaos in this thesis. 

Note that the condition, "xe U implies that p,(x) for some subsequence f, as 
L— + co, is contained in A ,” found in the above definition is not as restrictive as the 
condition, “xs U implies H.(x) — A,” found in the definition for an attracting set. It is 
also true however that the definition for an attracting set does not reguire the restriction 


that 4 be indecomposable. 


Clearly these two definitions for a “strange attractor” are quite dissimular. It should 
Become apparent that chaos is a topic with much diversity which is yet to be unified. 

The last property we will mention that is associated with a chaotic dynamical system 
is the existence of positive “Lyapunov exponents.” A continuous or discrete system with 
an attracting set that has a positive Lyapunov exponent 1s often classified as chaotic. 
This property is often associated with sensitive dependence on initial conditions. 

Before defining Lyapunov exponents and discussing them in-depth, we provide two 
examples of continuous third order autonomous systems which exhibit chaotic behavior: 
Duffing’s equation and the Lorenz equations. It should be noted that a continuous 
autonomous svstem requires at least three dimensions in order for a strange attractor to 
be present. This is a direct result from the Poincare-Bendixson Theorem which imphes 
that an attractor for a continuous two-dimensional autonomous system can consist of 
only equilibrium points, periodic orbits or unions of these invariant sets (see Figure 3 for 
example), none of which possess a transversal homoclinic orbit or “fractal dimension.” 
A presentation of the Poincare-Bendixson Theorem as well as the proof can be found in 
Coddington-Levinson [Ref. 3]. The theorem 1s presented in terms of limit points and 
limit sets of a semi-orbit. Efowever, two-dimensional discrete systems can also give rise 
to strange attractors, such as the Smale Horseshoe map and the Henon map. See 
Peitgen-Jurgens-Saupe [Ref. 11] for examples of two-dimensional discrete svstems with 


strange attractors. 
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IV. TWO EXNAMPLES OF CHAOTIC SYSTEME 


A. DUFFING’S EQUATION 


Dufling’s equation is a second order differential equation of the form 
PT r 3 5 - 
x"+ex +bx+ax =4f1) (50) 


where * represents diflerentiation with respect to z, the coefficients a, b, C, -mcnn 
constants (c representing damping), and /: R — R is a periodic forcing function with pe- 
riod T. 

Manv phenomena have been modeled bv an eguation of this form, including the 
dynamics of a buckled elastic beam and the movement of a particle in a plasma: EN 
our discussion we will choose the constants a and 6 to be equal to | and -1 respectively. 
With these choices equation (50) 1s equivalent to the following third order autonomous 


system: 


X = A) 
A (51) 
Du mod | 


We begin with the undamped unforced case: 4=0 and c=0. A Poincare map 
P: ll —= T1 can be formulated by choosing the plane IT to be parallel to the r-axis. Spe- 
cifically, let TI be the x,, x, plane where r— 0. In this case the image of the Pomns 
map is quite similar to the phase diagram for the Duffing equation (..e., 1t 1s equivalent 
to sampling the phase diagram in intervals of T). 

Fhe Poincaré map has three fixed points (-1,0), (1,0) and (0,0). These fixed points 


correspond to periodic orbits of period T for the continuous system (31). The Jacobian 
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matrices of P at (-1,0) and (1,0) have eigenvalues + i/3. The Jacobian of P at (0,0) has 
eigenvalues + |. The phase diagram and the image of the Poincare map are shown in 
Figures 20 and 21. The point q in Figure 20 1s a homoclinic point and the loops on ei- 
ther side of the point p = (0,0) are homoclinic orbits. 

For c some positive value and 4 = 0, the fixed points for the Poincaré map remain 
(-1,0), (1,0) and (0,0); however only (-1,0) and (1,0) are attracting. These attracting fixed 
points correspond to asymptotically stable equilibrium points. The stake diagram 1s 
protted in Tıgure 22. 

If we keep c positive and increase the forcing parameter / , the fixed points of the 
Poincare map shift and a transversal homoclinic point emerges near (0,0). Let p be the 
shifted fixed point from (0.0). Figure 23 depicts the changing manifolds of p and the 
emergence of transversal homoclinic points as À increases. 

We now give some preliminary definitions prior to stating a special case of the 
Smale-BirkhofF Ilomoclinic Theorem, which relates the presence of a transversal 
homoclinic point to the shift map defined in discussing the Smale Horseshoe. A map 
P:R’ > R is C’ ifall ofits first partial derivatives exist and are continuous. The map 
P: R > R' is C? if all mixed k* partial derivatives exist and are continuous for all k. A 
map P: R >R isa diffeomorphism if it is one-to-one, onto and C”, and its inverse is 
also C™. Recall that a fixed point p of the map P: R> R' is hyperbolic if the Jacobian 
DP(p) has no eigenvalues of unit modulus. 

Theorem 5: Let P:R’ > R be a diffeomorphism such that p is a hyperbolic point 
and there exists a transversal homoclinic point q + p. Then P has an invariant set A on 
which P is topologically equivalent to the shift map on LV’ (binary bi-infinite sequences). 

It should be noted that the Smale-Birkhoff Homoclinic Theorem is a generalization 


of Theorem 5 to maps P: R’ > R’. 
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Figure 20. Phase Diagram for 4 =0,c =0. 


Proof: The proof of the Smale-Birkhoff Homoclinic Theorem is detailed in 
Guckenheimer-Holmes (Ref. 4]. It links the geometry of a transversal homoclinic point 
to that of a Smale Horseshoe map bv wav of Markov partitions. 

We conclude from Theorem 5 that whenever the parameters are such that the 
Poincaré map for a continuous dynamical svstem, in particular Duffing’s equation, has 
a transversal homoclinic point then in the neighborhood of such a point the map has the 


same properties as the Smale Horseshoe: 
l. sensitive dependence on initial conditions, 
2. existence of a dense orbit, which implies topological transitivity, 


3. dense set of periodic points. 


That is, the Poincare map associated to Duffing’s equation is chaotic whenever the pa- 
rameters are such that a transversal homoclinic point is present. There has been much 
work done on this equation, and much ongoing research as well; see Guckenheimer- 


Holmes (Ref. 4]. 
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Figure 21. Image of Poincare Map for 4 =0,c =0. 


B. LORENZ EQUATIONS 

The “Lorenz equations” of meteorology are a third order autonomous system of 
differential equations. Formulated in an effort to model some of the unpredictable be- 
havior associated with weather, this system has become further popularized by the cha- 
otic dynamics it exhibits, such as the so-called “butterfly effect.” [t characterizes a fluid 


layer heated from below and cooled from above and is written in the following form: 


x’ =o(y— x) 
y'—rx—y—xz (52) 
z’ = xy — bz 


The variables x, y and z represent convective motion and the horizontal and vertical 
temperature variations, respectively. The parameters o (Prantl number), r (Rayleigh 
number), and 5 (an aspect ratio) are positive real constants. Although this system has 
been analyzed for a wide range of parameter values we shall adopt the traditional ones 


where o = 10, b= $ andr is varied. 
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Figure 22. Phase Diagram for 4 =0,c>0. 


For rl the Lorenz equations accurately model the dynamics of a convective sys- 
tem. For r “far” from one the equations are not an accurate model for the fluid’s dy- 
namics but have been used to model other physical systems. [Ref. 12] 

We begin by presenting properties of the Lorenz equations which are true for any 
values of o ,r and 6. First, there is a natural svmmetry of vanables under the transfor- 
mation (x,y,z) — (-x,-y.c). That is, any dynamical behavior that occurs in a particular 
octant is reflected through the z-axis to the octant diagonally opposite. 

Secondly, the origin is clearly an equilibmum point for the Lorenz system for all 
parameter values. Moreover, if an initial point (0,0, z,) is chosen, then direct inspection 
of the equations in (32) shows that x’(0) = y'(0) = 0, and 2'(0) = -bz,. Since z is arbitrary, 
this shows that the z-axis « = y = 0 is invariant, i.e., ows which start on the z-axis stay 
on it, and furthermore, tend toward the origin (0,0,0). Thus the z-axis is contained in 
W'(0). 

We will show that there exists an ellipsoid EcR' for which the flow along the 


boundary is always directed inward. This implies that there exists a bounded attracting 


set A defined by 
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Figure 23. Emergence of Transversal Homoclinic Points. 


4= Q 648). (53) 


To see that such an ellipsoid E exists, consider 


2 


Er = Gy) R`: O tl)Z—u—-0 4 
a RIDER: FAR ty —Url)Zz—n—0) (34) 


for u a positive constant. Showing that the dot product V of the velocity vector for (52) 
with the outward normal vector of E, is always negative implies that the flow is always 


directed inward along E:: 





a E, E 
O A 


= x” 2; —bz* + bz(r + 1). 


[f (x,y,z) is on the ellipsoid EB thats, 








a e 22 
E -(r+l)2z-u=0, (56) 
then 
en = Hd (57) 
which as negative (or sullseremulv kurse e. 


Note that anv ellipsoid which contains E, in its interior will have the flow along its 
boundary always directed inward. This implies that any flow starting a finite distance 
from the origin will stay a finite distance from the origin (1.e., no flows tend toward in- 
nity). 


The linearized svstem of (52) has Jacobian equal to 


-G Gul 
r—z -l -x|. (38) 
y c p 


cc cU 
r -1 OF (59) 
0 O -b 


which has eigenvalues 





ind, = — ,..__.. (60) 


wi 
to 


For r < | all eigenvalues of (59) are less than zero (1.e., the origin is asymptotically sta- 
ble). In fact, all solutions, not just those in some small neighborhood, tend toward the 
origin. Note that in this case the attracting set 4 defined in (53) consists of only one 
point, namely the origin, and W(0) = R`, ie., the origin is “global” sink. See Figure 24 
for a phase diagram schematic with r < 1. 


Bor: Ithe eigenvalues of (59) are 
4,=0, 4,=-(6 41). 2; =-0. (61) 


Two cigenvalues are negative and one 1s equal to zero. Thus for r=1 the origin 1s no 
longer asymptotically stable but still satisfies the definition of a stable equilibrium point. 

As r becomes greater than one, two additional equilibrium- points 
MD, er ZN) 1) andy =( oly —1). =. ob — !) .r— 1) appear which 
are initially asymptotically stable. The origin is now neither stable nor unstable for 
y>1. This transition as the parameter passes through r=1 is an example of a 
“bifurcation.” A discussion of bifurcations for continuous svstems can be found in 
Guckenhermer-Holmes [ Ref. 4]. 

oyo exsenvalies (4,, 4) of (59) are megative and one (/,) 1s positive. By 
Theorem 2 of Chapter II the unstable manifold W (0) at the origin has dimension one 
and W"(0) has dimension two. The eigenvalues for the Jacobian matrices evaluated at 
manda g all have real parts negative when I<r<r,. (When o=10 and b= $, 
ry = 24.74.) The equilibrium points g* and q- are asymptotically stable. The attracting 
Set? now consists of three points: the origin, g* and g-. See Figure 25 for a schematic 
for r close to but greater than one. 

For 1<r<r, the flow along the unstable manifold W'(0) approaches q` and g~. 
For r-values moderately larger than one, flows which start nearer to g* will spiral in to- 


ward it and those which start nearer to g” will spiral in toward that. As r increases past 


Figure 24. Phase Diagram r< 1. 


a critical value z’, the flows along the unstable manifold “cross over” and spiral in toward 
the “opposite” equilibrium point. (When o = 10 and b= $, r = 13.926.) Atr=r’ 
homoclinic orbits exist which contain the origin. See Figures 26, 27 and 28 for sche- 
matics tor | <r<r', r=r' and r' <r< r, respectively. 

AS r is increased past ry, the equilibrium points q” and q~ are no longer stable. The 
attracting set 4 increases in complexity. Using a version of symbolic dynamics similar 
to that of the Smale Horseshoe, it is possible to show that the Lorenz equations can 
eventually be classified as chaotic on 4 through the formation of transversal homoclinic 
orbits. Figure 29 illustrates a numerical solution of the “Lorenz attractor,” projected 
onto the xz-plane with o = 10,6 = + and r= 60. It is also possible to show that 4 is a 
strange attractor, possessing non-integer “fractal dimension;” see Rasband [Ref. 9]. 

The Lorenz equations are filled with much richness that we have not discussed. 
They exhibit horseshoes, a phenomenon known as “period-doubling” and also undergo 
a series of “homoclinic explosions.” Sparrow [Ref. 12] provides a detailed analysis of 


the Lorenz equations. 





Figure 25. Phase Diagram r > 1. 





Figure 26. Phase Diagram l <r<r'. 
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Figure 27. Phase Diagram r — z/. 
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Figure 23. Phase Diagram r’ <r < ry 


4 


INT 


7, Ha 
g 





Figure 29. Numerical Solution: (¢ =10,5= *,r=60.) Picture is from Sparrow 
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V. QUANTITATIVE MEASURES OF CHAOS 


A. LYAPUNOV EXPONENTS 

Up to now we were concerned with defining chaos and deciding whether or not a 
system was chaotic. Quantitative measures of chaos not only indicate when chaos is 
present in a dynamical system, but attempt to capture the degree of this behavior by 
assigning it a numerical value. Lyapunov exponents are one such quantitative measure. 

Lyapunov exponents are numbers which measure the amount of exponential diver- 
gence or convergence between flows with “close” initial points, and are normally associ- 
ated with a flow @(.x) (specifically a bounded flow such as on an attractor). Of most 
neen iS the largest Lyapunov exponent. If the largest Lyapunov exponent of an 
attractor ıs positive then it would seem plausible that the attractor would have sensitive 
dependence on initial conditions. In fact many authors call a system chaotic if the 
largest Lyapunov exponent for an attractor 1s positive. 

The full definition of Lyapunov exponents is somewhat involved, and the following 
non-rigorous argument suffices as motivation for the definition of the largest of them. 
et be a scalar, and consider the first order autonomous differential equation x’ = /x, 
Bi = thc solution of which is x — x;e“. Thus, a pair of imitial points separated by a 
aistance d,> 0 and allowed to flow from time Ô to time 7 eventually become separated 
“a distance d(t)— de“. If 2>0, then the flows diverge exponentially, regardless of 
how close they were initially/ 

More generallv, let & (x) be a bounded flow on an attractor, and let c(t) represent 
the distance between the flow f(x) and some “nearby” flow at time 1. Suppose now that 


alt= ay(1)e* for some “initial distance” function a (t) and scalar 4. Then Å is said to be 


a Lyapunov exponent for the flow (x). For k= 1,2,...,N,..... as t runs from some time 
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tı to a close but later time £, a “small” initial distance of d,(z,,) between these flows is 


multiphed by an exponential growth factor. That is, locally, 
A Au) 
dt.) ~ do" ly. )C x = * (62) 


Bevond this time value of 4, if the growth rate of (1) becomes “too large” for exponen- 
tial growth, then a new “nearby” flow is chosen with a new initial distance d,(4,), and the 


process 1s repeated; see Figure 30. The form of formula (62) suggests that 


Summing from k= I to N and taking an appropriate linut vields a precise definition: 


N 


; _ lim | y 
= 7 Y OR 0 64 
Ser EST een Cie (62) 

k=l 


Thus the largest Lyapunov exponent for the flow @,.x) can be estimated bv averaging 
the local expansion rates over time. Other expressions for 4 exist, as well as versions for 
flows of discrete maps. It should be noted that the choice of the exponenuial e in (62) 
is arr dr (base) 15 orten Sc 

Another method for estimating the largest Lvapunov exponent for a bounded flow 
&.(x) follows. We first provide the following definitions. Let L be a matrix with complex 
elements /,. A matrix L is defined as the Hermitian conjugate matrix of L if the elements 


of L are equal to the complex conjugates of the elements of L transpose nua 


~ 
| 
— 


). The trace ofan xn matrix L, Tr(L), is equal to the sum of its diagonal elements 


1) yi 


Ge (In) A) 
=] 
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Figure 30. Estimation of a Lyapunov Exponent 


[Instead of defining a Jacobian matrix evaluated at a single point, consider 
DAFO (x)), a Jacobian matrix evaluated for an entire flow. It depends on the parameter 


t and is illustrated by the following example. Given a flow for the Lorenz equations 


X(T) 


we have 


6l 


-o Gh) 
DORSO) =| ro 1 xo |, (66) 
O ae 


[t is possible to relate the distance «(1) between 6.x) and a “nearby” flow by the fol- 


lowing expression: 
did) = DAS (x))d(1). (67) 


An analvtic solution for «r) using (6°) ıs virtually impossible except in some special 


cuses. However, (67) can be integrated numericallv such that 
dt) = L(0dolty) (68) 


Where L(z) ts a matrix with the same dimension as Dio (x) (L.e, nxn). Thearees 
Lyapunov exponent is the average of the ergenvalues of L(s) with the largest real part 


as / goes from zero to infinity. Mathematically, for 4 the largest Lvapunov exponent, 


[790 


un — InfTr(L*(2)L(2))] (69) 


where L is the Hermitian conjugate matrix of L and Tr{L ()L(a)) ts the tracevonamae 
matrix product L (4)L(Z). The limit in (69) has been established by “multiplicative 
ergodic theorems” to exist for a large category of systems. 

It should be noted that an entire spectrum of Lyapunov exponents exists, largest to 
smallest. In general, for an n® order autonomous system there are n Lyapunov expo- 
nents. The spectrum of Lyapunov exponents for an equilibrium point p of the system 


x’ = f(x) consists of exactly the real parts of the eigenvalues of the Jacobian Df{p). 


For an attractor to eXist it must be true that the sum of the Lyapunov exponents is 
negative. It can also be shown that for a system x’ = f(x), if d (x) is bounded for 1 > 0, 
if P(x) does not tend toward an equilibrium point, and if f has a finite number of zeros, 
BR Dat least one of the Lyapunov exponents for (x) is zero; see Parker-Chua 
Net. 7]. 

With the last two statements in mind the onlv possible spectrum of Lvapunov ex- 
ponents (/,. 4,, 4;) for a three-dimensional system with an attractor is one where /, > O, 


A => 0, A, < 0 and A, < T 


B. FRACTAL DIMENSION 

Fractal dimensions are dimensions which allow non-integer values. The dimension 
of Euclidean space is the dimension with which we are most familiar and is not consid- 
ered a fractal dimension. It assigns only integer-valued dimensions; a point has di- 
mension Zero, a line dimension one, a plane dimension two, and a cube dimension three. 
Fractal dimensions are consistent with the dimension of Euclidean space in that a point, 
line, plane and cube all have the appropriate integer valued dimensions. 

We are most concerned with defining an appropriate dimension for invariant sets, 
in particular, strange attractors. Note that we have already seen that strange attractors 
can be defined as attracting sets with non-integer fractal dimension. Inasmuch as most 
(but not all) strange attractors exhibit chaos in the sense of possessing transversal 
homoclinic orbits (and thus sensitive dependence on initial conditions, etc.), the dimen- 
sions of non-chaotic attractors are always integers. 

We start with a notion of fractal dimension called capacity. Given an attractor A, 
cover 1t with appropriate volume elements (1.c., spheres, cubes, circles, squares, intervals, 
ere cach with diameter £. Let N(e) denote the number of volume elements with diam- 
SE “'nccded to-cover A. As ¢ decreases the number of volume elements N(e) needed to 


Boyer A increases, that is, 
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So ce? (70) 


for some constants c, and D. The capacity D.p 1s derived by solving (70) for D and let- 
tng e approach zero, that 1s, 


im I N (e) 
Lan ee Int) (71) 


provided the hmut exists independent of the shape of the boxes used to compute N(e). 
If the limit does not exist. the capacity is undefined. Capacity is also known as box or 
box-counting dimension. 


Consider the capacity for the unit square. Let the volume elements be boxes with 





& l > ’ . 
sides of length£——r. lf K — I then nine boxes are necessary to cover the unit sguare. 
a, 


2k 


lor k = 2. eighty-one boxes are necessary. In general N(e)= 3 boxes are necessanae 


cover the unit square. Letting € —> 0 is equivalent to tetting k > oo, thus 


„2k 
D,,— lim MS 22, (72) 


EF ane In 3° 
Notice that two ts consistent with the Euchdean dimension for the unit square. 
Now consider the Cantor Ternary set briefly introduced in Chapter Ill. TOS 
a subset of the unit interval and thus the appropriate volume elements will be intervals. 
After completion of the first step in our construction of the Cantor Ternary set we were 
left with two intervals (0, +], [4,1]. These intervals can be covered with two intervals 
of length one-third. In general after the k" step, N(e) = 2" intervals of length € = = are 


sufficient to cover the resulting set. Thus the capacity of the Cantor Le minas 





lim In 2 i a 5 
Deap = oes aa m3 = 06500 (73) 


Notice that D,,, is not an integer and that the value is less than the dimension of the unit 
interval (dimension one) of which the Cantor Ternary set 1s a subset. 
In calculating the capacity for attractors such as those found for Duffing's equation 


and the Lorenz equations, note that equation (70) can be written as 


In N(e) = Dn (+7) +Inc . (74) 


Thus, in a limiting sense, D,,, 1s the slope of the log-log plot of N(e) versus a 

N(e) can be calculated for an appropriate number of different -values by con- 
structing a grid of boxes (hyper-cubes) with sides of length e that cover an arca (n- 
dimensional phase space) which bounds the attractor. For Duffing's equation, n=2, 
and boxes are used for volume elements. For the Lorenz equations, n= 3, and cubes are 
used for volume elements. This grid of boxes (hvper-cubes) can be initialized in a 
boolean array with value FALSE. For each data point x, on the attractor determine in 
which box it is contained and change the corresponding array value to TRUE. N(e) 1s 
the number of elements in the array which are marked TRUE. 

It should be noted that for n greater than three, computer memory requirements 
become excessive. In this case other more efficient methods (see Parker-Chua [Ref: 7]) 
can be used for calculating D,,. Additionally the number of data points x, on the 
attractor used in calculating the capacity as Well as the other fractal dimensions 1s crit- 
ican) We will return to this issue at the end of the section. 

The next measure we shall discuss 1s called the information dimension. We maintain 
the notation that D(z) is the number of volume elements of diameter e which covers the 
attractor. The information dimension is based on the relative frequency that the 
attractor “visits” any particular volume element. Let Rabe the telativesirequency with 


which the attractor enters the i volume element. Define 
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H(e)=— ) Pin Py. (75) 


The information dimension ts defined by 


lim Ike) 


ASen M A 


Again if the linut does not exist D, is undefined. 


Consider the information dimension for the unit square with uniform probability 





e . se 4 2k . . l 
density. Then as seen earlier N(e)=3 boxes with sides of length £ — —r are NCO mI 
3 


to cover the unit square. Since the probability density ts uniform, the probability that 


a point chosen at random from the unit square is in a box with side of length 2 — «A 
| 


3 
138. Br 
equal tor e Sl Thus 
2 I 











o. 


3" 
19 == ) tein( te) to a (77) 
3 3 
i= tł 


and the information dimension 1s 
(78) 


Notice that D, for the unit sguare with uniform probability is egual to D,,, for the 
unit square. In fact it is always true that Dap = D, for uniform densiues. 


Next consider a unit square with uniform probability density equal to and the 


single point (2,0) with probability 5. If the volume elements are again boxes with sides 
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of length e = ailing then N(e) = 3% + | boxes are necessary to cover the unit square plus 


3 

the point (2,0). P,= > for the volume element covering the point (2,0) and 

— > (+) for the remaining 3* volume elements. Thus 

a 
| ci 
MM A nl ar 
a £ 203 O 
i=] 

| l 2k 2. 
=> In 2+>3 In (2.3 ) (79) 


in 2 as 


wr 


and 


2k 


lim ES | 
A |. (SO) 
i In 3 2In 3 


Thus D, 1s the average of the dimensions of the point and the unit square. This ıllus- 
trates how the information dimension can weigh the lower-dimensional subsets accord- 
ing to their relative frequency of “visitation, where as capacity tends to ignore the 
lower-dimensional subsets. It can be shown for any attractor that Di < Dap 

The final fractal dimension which we shall discuss is the correlation dimension. 
Keeping the same notation used for information dimension, the correlation dimension 


ws defined by 


core 


N(é) 
2 
In P; 
li =l > 
Deorr = ee m ; (81) 


67 


As an aid to interpreting the numerator of (SI), let N be the number of points x, of 


the attractor used to estimate D,,.. 1t 1s rather easy to show sneer 


Gel ur == {the number of pairs of points 
| 2 (82) 
(or such aras e} ' 
(SI) 1s equivalent to 
_ lim Ja Cle) 2 
Des: ~= ean Ine A (83) 


Once again consider the unit square and a single point. Let the volume elements 
| 


be Boxes wiih sides of lenih: S 
=) 





=. Then Me) =3%+1. Let P, -+( 3%) for the 


volume elements covering the unit square and P, = 


| 


for the.single point. Then 


ok 
3 
2 l l 
In Po TW ae 
od 4 oa a, 
== 


Ua 
~ 
m 
— 





(S4) 
| 194 
= In) ME 
N: 
which implies 
| ++) 
3 
Der = UR ; MY 
E 
3 4 
(S3) 
— Ô. 


Thus the correlation dimension completely ignores the umit square in this example. It 


can be shown that D,,,. = D) = Da, (on amy aut Uen 
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Other similar types of fractal dimensions exist which are also designed to reflect 
various statistical properties of the attractor. Related measures include entropy, 
Hausdorff dimension, and Lyapunov dimension which requires the values for the entire 
spectrum of Lyapunov exponents. This probabilistic approach to analyzing dynamical 
systems hus plaved an important role in the development of a formal discipline known 
as ergodic theory, which relies heavily on the classical theory of measure and integration. 
The main reason for choosing one fractal dimension over another is the ease and accu- 
racy of calculation, as Well as computational stability and robustness. Since this area 1s 
stull undergoing much active research it rs unclear which dimensions are preferable and 
Meurthe are related to one another. It is unlikely that the complexity of a strange 
attractor will ever be represented by a single number. 

Much of the power in determining an attractor’s fractal dimension is realized when 
working with data from experimental observations (1.e., time series). This provides an 
estimate of the minimum number of variables needed to model the systems” underlving 
dynamics. For example, if the dimension of the attractor is 2.7 then theoretically the 
underlying system can be modeled with three variables. 


This leads to two questions: 
l. How reliable is computational simulation of the true orbits? 


2. Ilow much data is necessary to estimate the fractal dimension of an attractor? 


The first question is answered by the Shadowing Lemma, see Guckenheimer-Holmes 
[Ref. 4], which states that a computed “pseudo-orbit” does approximate some true orbit 
ın a hyperbolic invariant set A. The second question is answered (specifically for cor- 
relation dimension estimated by the widely used Grassenberger-Procaccia algorithm) in 
Ruelle [Ref. 13]. Let N be the number of points on the attractor or number of exper- 


imentally observed data points used to estimate the correlation dimension. It can be 
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argued that in order for the correlation dimension to be estimated accurately by this al- 


gorithm the following relation must hold: 


correlation dimension < 2log¡pN . (S6) 


Thus 1f the correlation dimension 1s estimated to be 3.7 for a certain attractor then we 
should ensure that substanually more than 71 data points were used in the estimation. 
Although the relation in (S6) is specific to a fractal dimension calculated by a certain 
algorithm, the result suggests We should in general be Wary of any fractal dimension es- 


timated with a “small” number of data points. 
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APPENDIX - NOTATION 


We provide the following definitions for some of the fundamental mathematical 


notation used in this thesis. 


WG - ais a member of set A 


to 


R - the set of real numbers 


R” - the set of n-tuples (x,. ..., x,), where x, e R, i> 1,...,n 


Loe 


Ae set ol imtegers, (0. => 2. <<) 


the set Of non-negative imresers, (O, 1, 2, ...) 

6. @ - the set of rational numbers, ( wine Z. nz} 

7. f A> B-a function f with set A as its domain and set B as its range 
S. hof- composition of functions, hoflx) = h(flx)) 


9. Ref2) - the real part of the complex number A 


10. Im{z} - the imaginary part of the complex number A 


a 


us 


ca 
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